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(*^ , Abstract. Based on the variable Hilbcrt scale interpolation inequality bounds 

for the error of regularisation methods are derived under range inclusions. In 
this context, new formulae for the modulus of continuity of the inverse of 
bounded operators with non-closed range are given. Even if one can show the 
equivalence of this approach to the version used previously in the literature, the 
new formulae and corresponding conditions are simpler than the former ones. 
Several examples from image processing and spectral enhancement illustrate 

^ ' how the new error bounds can be applied. 
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lO ' and scalar products (■,■). We study linear inverse problems in form of ill-posed 
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1. Introduction 



(1) Af = g, / € X, g e Y, 

characterised by an injective bounded linear forward operator A : X ^Y for which 
the range range(A) is a non-closed subset of Y . Then equation (1) is unstable in 
the sense that the inverse operator A~^ : range(^) <ZY^fX\s unbounded and 



C^ ' hence the use of perturbed data g* instead of the exact right-hand side g with 

(2) ||.9-.9'||<'5 

and noise level (5 > may lead to arbitrarily large errors in the solution of (1) 
even if the noise level is extremely small. As a consequence of this ill-posedness 
phenomenon regularisation methods are required for the stable approximate solu- 
tion of the inverse problem. Their basic idea consists in finding approximations to 
the exact solution / in form of solutions /„ = /«(<?) to stable auxiliary problems 
neighbouring (1). Those solutions are obtained by using the noisy data g^ . The 
degree of neighbourhood of the exploited auxiliary problems is controlled by a reg- 
ularisation parameter a > 0. In this context, small a express closeness to (1) in 
combination with a low level of stability, whereas larger a ensure better stability, 
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2 MARKUS HEGLAND AND BERND HOFMANN 

however combined with a low level of approximation. For the success of any regu- 
larisation method an appropriate trade-off between stability and approximation has 
to be aspired when choosing the regularisation parameter. 

As already outlined and summarised in the monograph [9] by Engl, Hanke 
and Neubauer a successful way for doing regularisation for linear ill-posed prob- 
lems in Hilbert spaces including convergence and convergence rates of constructed 
methods requires some knowledge on the impact of smoothness on the regularised 
solutions. Smoothness should be understood there in a very generalised sense as 
both solution smoothness and smoothing properties of the forward operator. In [9] 
such smoothness fitting is focused on Holder type source conditions yielding Holder 
type convergence rates when the regularisation method has a sufficiently high level 
of qualification. This theory is closely connected with associated (classical) Hilbert 
scales, where we refer to the seminal paper by Natterer [27]. An extension of 
that theory to generalised source conditions implying also more general convergence 
rates was performed rather independently by two different approaches. The first 
approach initiated and established by Hegland (see [11, 12]) introduced variable 
Hilbert scales with positive index functions the behaviour of which is in particular 
of interest for large arguments covering the spectrum of an injective unbounded 
linear operator with bounded inverse. Results in this approach are based on inter- 
polation inequalities. An alternative second approach was developed and published 
by Mathe and Pereverzev (see [24, 25, 26]) and complimented by ideas of HOF- 
mann and other co-workers (see, e.g., [15, 16, 17]). This approach, in principle, also 
exploits variable Hilbert scales, but the index functions occurring there are more 
specific and their behaviour is of interest just for small positive arguments covering 
on the spectrum of A* A. The index functions of the second approach are monoton- 
ically increasing and tend to zero as the positive arguments tend to zero. Here we 
call them rate functions abbreviated by over-lined small Greek letters, because they 
also express the convergence rate of approximate solutions. One of the main goals 
of this paper is to compare both approaches, their results, required conditions and 
their natural interplay. Moreover, some more consequences and new convergence 
rates results of Hegland's approach shall be formulated and proven in the sequel. 

In our study we use variable Hilbert scales and corresponding interpolation in- 
equalities in order to obtain bounds from above for the error ||/ — /q|| of regularised 
solutions under conditions imposed on /. As is well-known the convergence of reg- 
ularised solutions /«—>■/ in X, even if 5 — > -1-0 and a = a{S,g^) — ?► -fO is chosen 
in an appropriate manner, can be arbitrarily slow for solutions / which are in some 
sense non-smooth with respect to the forward operator A. It is of essential interest 
in regularisation theory to obtain convergence rates 

(3) ||/-/„||=0(f7(<5)) as d^+Q 

with appropriate rate functions fj. 

For a non-closed range of A convergence rates require that general source condi- 
tions are satisfied which attain in the standard case the form 

(4) / = iJj{A*A)v 

with source element v €z X and with some rate function ip defined at least on 
the interval (0, ||A||^] covering the spectrum of A* A. Here, ip{A*A) is well-defined 
as an injective bounded positive self-adjoint linear operator by spectral calculus 
(see, e.g., [9, Section 2.3]). If the regularisation method has a sufficiently high 
qualification (see, e.g., [15, Definition 2.6]), then an asymptotically fast decay of 
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■(^(i) — >■ as i — )- +0 corresponds with high order convergence rates (3) of regularised 
solutions and vice versa. Note that the tool of general source conditions with rate 
functions ip different from monomials was early applied to regularisation theory by 
Tautenhahn in [33]. Later Homage (see [19, 20]) studied in detail the case of 
logarithmic functions ip in (4) and corresponding convergence rates. 
Using a non-standard source condition 

(5) f^Gw 

with source element w Cz X, the priori information about the smoothness of the 
solution / can be expressed by an injective bounded self-adjoint positive definite 
linear operator G : X -^ X, where range(G') is a non-closed subset oi X. In most 
cases the character of the operator G is rather independent of the forward operator A 
and hence G need not be a function of A* A. However, in order to make conclusions 
to convergence rates of regularised solutions the assumption / £ range(G) of (5) 
and the assumption / e TSingc{tp{A* A)) of (4) have to be connected anyway. In the 
framework of Bottcher et al. [6] conditions for such connections and their interplay 
are discussed in a comprehensive manner. In [15] they are called link conditions. 
Besides the simplest link type G = ifi{A*A), which is typical for commuting G and 
A* A, one of the most convincing class of link conditions represent range inclusions 
introduced with Yamamoto in [18] to regularisation theory. The favourite form of 
such inclusion is 

(6) range(G) C Taiige{i:{A* A)) 

with some rate function ip. Evidently, under (5) a range inclusion (6) immediately 
implies a source condition (4). The higher the rate expressed by ^p is, i.e. the faster 
the decay ^(i) — >■ as i — >■ -1-0 goes on, the smaller the set Tange{'tlj{A* A)) becomes. 
Hence the condition (6) is a strong one for higher rates ip and vice versa. 
An alternative link condition is 

(7) ||^(G')x|| <C 11^x11 foraUxeX 

for some constant C > 0, where the rate function g acts as a benchmark for the 
degree of ill-posedness of equation (1) with respect to the a priori information (5). 
From Proposition 2.1 in [6] we know that a range inclusion range(Gi) C range(G2) 
and a condition of the form ||Gia;|| < G||G2a;|| for all x £ X and some G > are 
equivalent. Consequently, with Proposition 2.18 in [9] the condition (7) is equivalent 
to the range inclusion 

(8) range(e(G)) C rangc(A*) == rangc((^*yl)^/") 

taking into account the identity \\Ax\\ = \\{A*Ay^'^x\\ for all x £ X. 

As exploited in [6, § 4] one can reduce (8) to the form (6) with ■!/)(i) = §^^{Vt) if 
[^~^(vt)]^ is an operator monotone function (cf. [5]. An important special case of 
that implication, namely for g(t) = t~' with < /x < 1/2, is well-known as Heinz- 
Kato inequality (see, e.g., [6, Proposition 8.21] or the corollary of Theorem 2.3.3 
in [32, p. 45]). In that special case, (8) yields (6) with ■0(i) = t^ for exponents 
0</x< 1/2. 

In the next section we review the definition and some properties of index func- 
tions and variable Hilbcrt scales. The fundamental interpolation inequality is given 
with a short proof together with an application to a general regularisation method. 
We then show how the variable Hilbcrt scales provide natural source conditions. In 
the third section bounds for the modulus of continuity are given in a variable Hilbert 
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scale setting. An important part of this section compares the new bounds on the 
modulus of continuity with some obtained earlier and shows how the new results 
have a substantially simpler structure. The fourth section analyses linear regular- 
isation methods and parameter choices using the variable Hilbert scale approach. 
In section 5 we consider several examples from image processing and spectral en- 
hancement and the paper finishes with some final remarks. 

2. Interpolation inequalities and consequences 

The main tool used here to derive error bounds for regularised solutions is an 
extension of interpolation inequalities to variable Hilbert scales. For classical Hilbert 
scales {Xr}res. - with real numbers as scale index r - interpolation inequalities 
are well-established. These interpolation inequalities were initially applied to the 
treatment of linear ill-posed problems (1) by Natterer in [27] (see also the monograph 
by Engl, Hankc and Neubauer [9]). For variable Hilbert scales, new interpolation 
inequalities have to be formulated. Here the scale index r is replaced by a wide 
class of index functions defined as: 

Definition 2.1. We call a real function 9 defined on the open interval (0,oo) an 
index function if it is continuous and positive. The index set denoted by X is then 
the set of all such index functions. 

We call an index function S Z a rate function if it is monotonically increasing 
and if it satisfies the limit condition lim 9(t) — 0. 

Note that any monotonically increasing continuous function 9(t) defined on a finite 
interval (0,to] satisfying lim 9{t) = can be extended to a rate function 6 such 

that 6{t) ~ 9{t) for t £ (0,to]- Furthermore, the index functions corresponding to 
the classical Hilbert scales Xr can be seen to be power functions 9{X) = X'' for real 
r. Rate functions are obtained for this case if r > 0. 

The set of index functions I includes the positive constant functions and all 
power functions but not the zero function. We denote the pointwise operations 
hy (f> + ip, (j)ijj and 4>/tp, respectively. As usual, multiplication by a constant 7 is 
denoted by 71^. The composition is denoted by (/> o -0 where {(j) o ip){X) = (j){ip{X)). 
The pointwise maximum of two index functions is V V' defined by (0 V ip) (A) = 
max((/)(A), V'(A)) and the pointwise minimum is (j) Aip. One verifies that the index 
set I from Definition 2.1 is closed under 

• point-wise addition, multiplication and division, 

• multiplication with positive constants, 

• pointwise maximum and minimum and 

• composition. 

If an index function is injective and surjective, the inverse denoted by i/)"^ is also 
an index function. Not every index function is invertible, however. The reciprocal 
function of cj) (with values l/(/)(A)) is denoted by l/(f>. 

The variable Hilbert scales arc then families of Hilbert spaces indexed by I. 

Definition 2.2. For a given injective self-adjoint positive definite linear operator 
T densely defined on a Hilbert space X we define the variable Hilbert scale {Xg}g^i 
as a family of Hilbert spaces Xg indexed by functions 9 from the set I of index 
functions in the sense of Definition 2.1. Every Hilbert space Xg with 6* e / is then 
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the closure of the domain of the quadratic form 

(9) \\f\\l^{f,e{T)f). 

In such a way, variable Hilbert scales were introduced by Hegland in [11] for 
the special case of T being the inverse of a compact operator and in [12] for more 
general T. The choice of the operator T determines the Hilbert scale. In the simplest 
case where both T and its inverse T~^ are bounded all the Hilbert spaces Xg are 
isomorphic to X because of the continuity of the index functions 9. In this paper, in 
the context of ill-posed problems (1) we often assume that T is unbounded but has 
a bounded inverse, i.e. the spectrum of T is contained in the interval [[|r~^[|~^,c>o) 
and has +00 as an accumulation point. As the function 1/A is an index function and 
the set of index functions is closed under composition, the inverse T~^ generates 
the same Hilbert scale as T. It is thus not necessary to consider variable Hilbert 
scales generated by invertible T and bounded T"^ separately. The more general 
case where both T and the inverse T~^ are unbounded is only considered for the 
negative Laplacian T = —Delta and in particular T = —d^/dt'^. For the more 
general case where also A is unbounded we refer to the recent paper [17]. To get a 
link with (1), a particular T is suggested either by the forward operator A, by the 
operator G of condition (6) or based on a combination of both. A common choice 
is T = [A* A)^"^ for injective operators A with a non-closed range. It follows that 
A* A = 0{T) if 0{X) = 1/A. For classes of problems connected with deconvolution, 
however, T = ~d^ /dx^ on L2{M) is the canonical choice as T is the generator of 
symmetric convolutions. An index function 6 such that A* A ^ d{T) is then found 
using Fourier transforms. More generally, for problems where the source conditions 
relate to smoothness, T = —A can be chosen. In such a case A denotes the Laplacian 
on L2{^) for some domain Vt C W^. 

It was shown in [12] that there exists a continuous embedding X^ ^-> X^ if and 
only \i (j) < ^ ip for some constant 7 > 0. If two different index functions Oi and 62 
are identical on the spectrum of T they define the same norms and hence the same 
space Xe^ = Xe^ . If they differ on the spectrum they do define different norms, 
however, these norms may be equivalent and thus the Hilbert spaces Xg-^ and Xg-^ 
as elements of the variable Hilbert scale {Xg}o,^i are indistinguishable. 

The most important connection between the norms of different spaces Xg is the 
interpolation inequality for variable Hilbert scales. 

Lemma 2.3 (Interpolation inequality). Let T be an unbounded injective self- adjoint 
positive definite linear operator densely defined on the Hilbert space X with bounded 
inverse T^^ : X — > X. Moreover let (p^ip^O and ^ be index functions such that $ 
is concave and 

(10) 0(A) <* (7/; (A)), for \\T-^\\-^ < X < 00. 

Then for any element 7^ / G Xg D X^g one gets f G X^g and 

(11) 

Proof. Let in the following the measure v be defined by 

di^W = \\f\\g'9{X)d{f,E{X)f) for ^ f e Xg 
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where E{X) is the spectral family or resolution of the identity defined by T. By def- 
inition, because 9 is positive and the integral of dv equals 1, i/ is a probability mea- 
sure. Taking into account that / <S X^,g and that \E' is concave we obtain from the in- 
verse Jensen inequality that J^ ^(V'(A)) dv{X) < ^ (/p°° i'W di'{X)) < oo. Because 
integration is monotone and the inequality (10) holds one gets J^ (j){X) dv{X) < 
/q ^('(/'(A)) diy{X) < oo and hence / € X^g. Summarising the results we arrive at 
the inequality 

/■oo / /-oo 

/ (/)(A) dzy(A) < * f / V(A)di^(A) 

which provides us with the required inequality (11) by replacing dh'(X) by its defi- 
nition. D 

The concavity of ^ is the key property which enables us to use Jensen's inequality. 
The Lemma 2.5 below shows that this property has only to be established for large 
arguments. We can focus on large arguments, if the spectrum of T for T under 
consideration contains only sufficiently large values and has -t-oo as an accumulation 
point. We need some auxiliary result: 

Lemma 2.4. 1/9 : [io,oo) ^ (0,c») is concave for some to > then 9 is mono- 
tonically increasing. If moreover lim 9{t) = oo, then 9 is even strictly increasing. 

Proof. We show the contraposition. Assume that 9 : [to,oo) — > (0, oo) is not mono- 
tonically increasing. Then there exist ig < ii < ^2 such that 9{ti) > 9{t2). Let 

m^^9{t,) + ^9{t,) 

12 — tl t2 ^ tl 

be the linear interpolant of 6* in [<i,i2]- As the slope oil{t) is {9{t2)—9{ti)) / {t2—ti) < 
one has l{t) -^ — oo for t -^ oo. As 9{t) > there exists a is > t2 such that 
^(^3) > 1(^3)- By rearranging this inequality one gets 

9it2)<'-^9{t,) + '-^9{t,) 

and so 9 is not concave. The strict monotonicity for lim 9{t) = 00 follows imnicdi- 
ately from the fact that the hypograph of a concave function is a convex set. D 

Now we can replace index functions which are concave for large arguments by 
such which are globally concave in the following way: 

Lemma 2.5. Let 9{X) be an index function which is concave and hence by Lemma 2.4 
increasing on the interval < Aq < A < 00. Then there exists an index function 
^(A) which is concave for all < X < 00 such that with some Ai > Ao one has 

^(A) = 61(A), for Ai < A<oo, 

*(A) = A*(Ai)/Ai, for 0<X<Xi. 

Proof. To obtain the assertion of this lemma we consider the set of real numbers 
{a I aA > ^(A),Ao < A < 00}. As 9{X) is concave for Aq < A < 00 this set is not 
empty and it is bounded below by zero. Thus it does have a greatest lower bound 
ao > such that 

• "oA > 9{X) for Ao < A < 00, 

• there is a Ai such that aoAi = ^(Ai) if not, ao would not be the greatest 
lower bound. 



REGULARISATION ERRORS AND VARIABLE HILBERT SCALES 7 

Hence, knowing from Lemma 2.4 that an index function ^ which is concave for all 
< A < oo is always increasing, the function ^{X) can be composed of a linear 
function growing from zero to 0{Xi) in the interval (0, Ai] and coinciding with for 
greater arguments. D 

The interpolation inequality is the main tool to obtain error bounds for solvers 
of linear ill-posed problems. However, taking into account Lemma 2.5 by inspection 
it becomes clear that rate results derived from Lemma 2.3 are only based on the 
behaviour of ^I/(A) for large A > Ai. Without loss of generality ^ can be amended 
for < A < Ai by the linear function *(A) = *(Ai)A/Ai for < A < Ai. 

Three typical choices for ^(A) being concave at least for sufficiently large A are 

• *(A) = A'' where k £ (0, 1) 

• *(A) = A/log(A) 
. vl/(A) = log(A). 

For all three choices we have the limit condition 

(12) lim ^^ = 

A— >oo A 

and one gets the following versions of interpolation inequalities from Lemma 2.3: 

• For \I>(A) = A" one gets 

ll/IUe<ll/ll^'=ll/li;., 

• for ^(A) — A/log(A) one gets 

llfll < \\f\\'>f>S 

^'" v/21og(||./||WII/IU)' 

• and for 4* (A) = log(A) one has 

l!/IUs<ll/llev'2iog(||/||wll/lle. 

Asymptotically, i.e. for H/Jle -^ 0, the interpolation inequality allows us to find 
error bounds in the application to the error estimation for the solution of equation 
(1). One aims to get bounds for the norm ||/|| in X using values of the image norm 
\\Af\\ in Y and values of the norm IJ/Hv-e which expresses the specific additional 
smoothness of /. The terms in the interpolation inequality (11) are then 

ll/IUe = 11/11 for feX^e and \\f\\g = \\A,f\\ for f e Xg. 

The first condition leads to (f){X)6{X) — 1 for all A and the second condition gives 
0(T) = A* A and with e{X) := 1/X the relations T = {A* A)'^ and (/)(A) = A. We 
are still free to choose the index functions ip and do it in the form tl'{X) := x{X) X 
with an appropriate index function x- 

For later use we add here some observations about convex functions which are 
stated as a lemma: 

Lemma 2.6. Let ^ : (0,oo) — > (0,oo) be a concave function. Then we have the 
following properties: 

(a) The function S : (0,oo) — )■ (0, oo) defined by 

*(A) 

(13) E{X)~^-^, 0<A<oo 

A 

is monotonically decreasing. 
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(b) The function $ : (0, oo) — > (0,oo) defined by 

(14) $(^):=^*(^-V 0<Ai<oo 

is concave and hence monotonically increasing. 
Proof, (a) Let < Ao < Ai < A2. As 4' is concave and positive one has 

*(AO>^-4^*(A2) + ^^*(Ao) 

A2 — Ao A2 — Ao 

A2 — Ao 

As this holds for arbitrarily small Ao > on has 

*(Ai)>^*(A2) 
A2 

and consequently S(Ai) > S(A2). This proves assertion (a) of the lemma. 

(b) Let < /io < /ii < /i2 and A^ = l/^fi- Then one has < A2 < Ai < Aq and 

by the concavity of ^ and some simple algebraic manipulations one gets 



1^2-1^^ M2-M0 i-i ^2 ^- 


- XT *(Ao) 


Al \Ao — A2 Ao — A2 / 




<lvI/(Ai) =$(/,!). 

Al 





It follows that $ is concave and hence by Lemma 2.4 also increasing. This completes 
the proof of the lemma. D 

Remark 1. We note here that the transformation S : ^gIi-^$gT according 
to formula (14), applicable to every index function and preserving concavity^ is 
an involution., that means S~^ = S and hence 5 is bijective. If the concave index 
function ^ satisfies lim ^(A) = 00, then by Lemma 2.4 the function is even strictly 

increasing and if, in addition, ^ is a rate function, i.e., it satisfies the additional 
limit condition lim ^(A) = (which is also motivated by Lemma 2.5), the inverse 

function ^^^ is a well-defined and convex index function. If, on the other hand, 
the limit condition (12) holds, then we have 

lim $(Ai) = lim ^^(1/^)= lim \I'(A)/A = 

p— >+0 /^— >+0 A— s-oo 

and taking into account Lemma 2.6 (a) and (b) one sees that $ = 5(^) is a concave 
rate function. Vice versa we have that ^ = 5($) satisfies (12) whenever $ is a rate 
function. 

By inspection of the proof of Lemma 2.6 one can also see the following facts: If 
^(A) is only concave for A S [Ao, 00), then $(^) = [5(^)](^) is concave for // e (0, /i] 
with /io = 1/Ao. The involution S preserves also the convexity of an index function 
and if the concavity or convexity is strict, then the strictness carries over to the 
transformed function. 

Now we are ready to draw conclusions from Lemma 2.3. A first, abstract ver- 
sion of bounds for errors of regularised solutions is given in the following corollary. 
We will denote by /« an approximation of a solution / to equation (1) which is 
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computed from an approxim.ate right-hand side using a regularisation method and 
a regularisation parameter a > 0. 

Corollary 2.7. Let A : X ^ Y be an injective bounded linear operator with non- 
closed range mapping between the two Hilbert spaces X and Y . Furthermore let the 
variable Hilbert scale {X^},y^j be generated by T = {A*A)~^ such that any scale 
element X^ has a norm denoted by || • \\,^. Moreover let x o-nd ^ be index functions 
and ^ be concave such that 

(15) *(x(A)A)>A for all \\T-^\\-^ < X < oo . 

If the solution f to (1) in addition satisfies the condition f G X-^ and if fa G X-^ is 
such that 

(16) ||/„-/||x = C>0 

(17) \\Afa-g\\^t>Q 
then 

(18) ||/-/a||<6V*(CV^. 

Proof. By Lemma 2.3 with 6{\) = 1/A, 0(A) = A, '0(A) = x(A) A and for a concave 
index function ^ satisfying (15) one has for all 7^ ft- G X^ 

/ ii;,i|2 \ 

(19) \\hf < \\Ah\\ 

Setting h -.^ fa — f this yields the estimate 

Wfa -f\\'< \\A{fa /)f * I „r; ^".1l. I = ^'*((CA)^) 





and proves the assertion of the corollary. D 

Results similar to those of Corollary 2.7 can be found for other choices of T, see 
for example Corollary 5.3 where T = —d^/dt^. The Corollary 2.7 can be interpreted 
as an instance of an abstract Lax theorem [1] where the condition (16) is a stability 
condition and the bound (17) relates to consistency. 

Note that the error estimate (18) of Corollary 2.7 requires the essential conditions 
/ G X^ and fa € X-^, i.e. the approximate solutions fa are constructed such that 
they obtain the same smoothness level with respect to T as the exact solution /. A 
next step for drawing conclusions of Lemma 2.3 will be formulated in Corollary 2.8 
by assuming that / belongs to ball 

(20) B^{R):={heX^: \\h\\^ < R} 

in X^ with positive radius R ~ Ri and that the approximate solutions fa for all a > 
under consideration belong to another such ball with radius i? = i?2- Moreover, 
we consider for data g^ satisfying (2) the limit process (5 — > +0 in correspondence 
with associated regularized solutions fa , where the regularisation parameter a > 
is chosen either a priori as a = a{S) or a posteriori as a = a{6, g ). 

Corollary 2.8. Under the setting of Corollary 2.7 let the limit condition (12) be 
satisfied and let f G B^{Ri), Ri > 0. Moreover with prescribed Smax > let 
fa S B^{R2), i?2 > 0, for all a attributed to 6 G (0, S„iax\ o.Tid g satisfying (2) such 
that 

(21) \\Afa-g\\<caS), 0<S<S^a., 
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for some rate function ^ and some constant C > 0. Then we have 

(22) 11/ -/all <<;««) 



\ 



* 



Ri + R2 



0<6<S„ 



cm 

where the upper bound in (22) is a rate function, i.e., it tends to zero as 5 -^ 0. 







Proof. Since ^ is concave by Lemma 2.4 the error norm e ^/^tCV^ obtained 
from (18) is increasing in C > for fixed e > and as a consequence of Lemma 2.6 

(a) this upper bound e ^/W(^^Je^ = C y ~wnw' ^^ increasing in e > for fixed 
C > 0. Moreover, due to (12) in the limit process e — > for fixed C > implying 
C/e — > 00 this bound and hence the error norm in X even tends to zero. For 
the mentioned kinds of monotonicity we obtain formula (22) by e < C^{5) and 
C = I!/ - /allx < ll/l!x + ll/allx < Ri+ R2_- The Upper bound in (22) is a rate 
function declining to zero as (5 — >■ because ^ is a rate function. D 

Remark 2. As a special case for the situation of Corollary 2.8 we can consider an 
a posteriori choice adis = oidis{S,g ) for the regularisation parameter realised by a 
discrepancy principle 

(23) \\Af^,^^ - g'W = Cd^sS 

with some prescribed Cdis > 0. Then by using the triangle inequality we obtain 
with (2) as noise model 

!IA/a.„ - .911 < P/a,„ -/li + 11/ - 5|1 < {Cd:s + 1) S = C S . 

Then for such a = adis under (12) the regularisation method converges strongly in 
X with the convergence rate 

(24) 11/ - /all = 0(^5^*0^) as 

for some constant ^ > 0. Note that beside the assumption / £ B^{Ri) on the 
solution smoothness for that result the strong condition fa(s.g^) ^ -^^(^2) for all 
5 G (0, 5max] and all associated g^ satisfying (2) is required. 

The convergence rate in (24) depends only on the asymptotic behaviour of ^(A) 
as A — ?> 00. Thus the alteration of \I'(A) for small A in the sense of Lemma 2.5 has 
no influence on that rate. For the class of functions ^(A) = A** with < k < 1 rate 
functions proportional to J^"*^ occur in (24). All those error rates are lower than 
the rate 5 which is typical for well-posed problems. It should be mentioned that 
\I'(A) = A fails to satisfy the condition (12) and used in Corollary 2.7 the inequality 
(19) does not yield a convergence rate. 

To get a feeling for the role of the solution smoothness / S X^ we can study 
consequences of the inequality (15) as a hypothesis of Corollary 2.7 taking into 
account Lemma 2.4. One consequence of (15) is the limit condition liniA-i-cx) ^(A) — 
00 for the function ^ which is because of its concavity then strictly increasing 
and invertible with convex ^"-'^(A) also tending to infinity as A — > 00. Then (15) 
implies x(A) > — j^ for large A. Under that condition (12) is equivalent to 
liniA-s-oo 4'~^(A)/A = cx). Hence, the index function x(A) tends to infinity for A — > cx3 
provided that (12) holds true. 

When setting (j){\) :— A, 9{\) :— 1/A and '0(A) := *^^(A) in the interpolation 
inequality (11) then the corresponding regularity condition f G X^g is equivalent 
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to a source condition (4) which expresses the specific smoothness of the solution / 
with respect to the forward operator A of equation (1). 

Proposition 2.9. Let ^(A), for < A < oo, be a concave and strictly increasing 
index function satisfying the limit conditions lini 'I'(A) ~ 0, lini ^(A) = oo 

A->+0 A— )-oo 

and (12). Moreover let T = [A* A)^^ and set <f>{\) := A, 6{\) := 1/A as well as 
ip{X) := ^^^(A) for < A < oo. Then we have f g X^e if and only if f satisfies a 
source condition (4) with the function 

(25) ^{t) = , < i < oo, 

which is then a rate function. 

Proof. Under the stated assumptions the function ip is weh-defined and a rate func- 
tion. Namely, we can write , = \/ when usina; the substitution 

•" ^t^-^i/t) V '" *= 

u := \E'~^(l/t). The variable u > is strictly decreasing with respect to t > 
such that u — >■ oo corresponds with t — > +0 and vice versa t — >■ oo corresponds with 
u -^ +0, because ^~^ is also strictly increasing and we have lim \I>~^(A) ~ oo 

A— foo 

and lim ^P^^fA) = for the functions ^ under consideration. Now by (12) we 

have lim — ^ = and with Lemma 2.6 (a) the quotient — ^ is monotonically 

decreasing in u > 0. This, however, implies that ipit) is monotonically increasing 
for i > with limit condition lim '>h(t) = 0. Hence, i/j is a rate function. 

t~y+0 

Moreover, we have 

fex^e <=> (/,*-i(T)r-V)<oo 

and 

/ = i;{A*A)v, for veX -^=^ {yj{A*A)]^^f, [iP{A* A)]-^ f) < oo . 
One has equivalence if and only if 

[^-^{{A*A)-^)]{A*A) = [^{A*A)]-^ 
and the claim follows. This proves the proposition. D 



After the millennium Mathe and Pereverzev with coauthors seized, reused 
and extended Hegland's ideas and concepts of variable Hilbert scales and corre- 
sponding interpolation inequalities from [11, 12] for linear ill-posed problems and 
their regularisation (cf. [24, 25]) and combined it (cf. [15, 26]) with the concept of 
approximate source conditions (cf. [8, 14]). The comprehensive theory developed 
therein considers only rate functions as index functions. Such an approach leads 
in general to different formulae compared with the results based on the concept of 
Lemma 2.3, but as we will outline in the sequel clear cross-connections and some- 
times even equivalences of the assertions obtained characterise the two different 
ways. 
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3. Modulus of continuity of A^^ 
The modulus of continuity of A~^ restricted to the set AM with M C X is 

u}{M,S) = sup{||a;|| : x e M, \\Ax\\ < S}. 

The impact of the modulus of continuity on error bounds in regularisation has 
recently been discussed in the paper [16, §4]. It is well-known that the worst case 
error 

e(/, A/, <5) := sup e(/, /, 5) for e(/, /, S) := sup \\fig') - f\\ 

f&M g'eY:\\Af-g^\\<S 

of linear and nonlinear reconstruction methods / : g^ £ Y t-^ fis^) ^ -^ ^^^ ^^^ 
infimuni 

e(Af , S) := inf e(/, M, S) 

f: Y^X 

which satisfies for centrally symmetric and convex sets M the inequalities 

uj{M, S) < e{M, S) < uj{M, 26) < 2u}{M, 5) . 

Hence the modulus of continuity w(Af , S) serves as benchmark for the reconstruction 
error of / when f,fGM can be assumed. For example, from [16, Lemma 4.2] one 
can find a minimax-expression for the modulus of continuity in the case of centrally 
symmetric and convex source sets for AI of the form 

(26) M = G[B{R)] ■.= {xeX : x = Gv, v e X, \\v\\ < R} . 

corresponding to condition (5). This expression gets an explicit bound from above 
for the special case G = -11) {A* A) and 

M = iP{A*A)[B{R)] ■.= {xeX : x = iJj{A*A)v, v e X, \\v\\ < R} 

associated with the source condition (4). Note that the rate function '0(i) is only 
of interest here for arguments < i < || Ap, but without loss of generality (cf. [17, 
Theorem 1 (b)]) we can extend -0 to be a monotonically increasing index function 
defined on (0,oo). Then by using the strictly increasing auxiliary function 

(27) e(t) := Vtipit) , < i < oo 

satisfying the limits conditions lim Q(t) = and lim Q(t) = cxj one obtains for 

t— y+O t— >oo 

M ^ij{A*A)[B{R)] 

(28) oj{M,S) < Ri;(e~^(^^Y <5 > 

provided that 

(29) ip^{{e^y^{t)) is concave for < i < oo . 

This result can be derived from Corollary 3.7 and Theorem 2.1(c) in [16] (see also 
Theorem 1 in the earlier paper [25]). A similar assertion was already mentioned in 
a rudimentary form in a paper by Ivanov and Korolyuk in 1969 [21]. 

The following proposition also yields an upper bound for the modulus of conti- 
nuity based on a variable Hilbert scale interpolation inequality using Lemma 2.3 or 
Corollary 2.7. For the proof we use Lemma 2.6 (b). 
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Proposition 3.1. Let ^(A), for < A < oo, be a concave and strictly increasing 
index function satisfying the limit conditions lini ^(A) = 0, lim ^(A) = oo and 

A— >-+0 A— >oo 

(12), for which an index function x exists that satisfies 

X(A) > *"i(A)/A, 0<A<oo. 

Furthermore let X^ he an element of a Hilbert scale generated by T — [A* A)^^ 
where A is injective. Then 



(30) oj{M,6)<sJ^(^\ 5>0 

forM = B^(R). 

Proof. Under the assumptions stated on ^ and x Corollary 2.7 applies. Then from 

I / i|/i|p \ 
formula (19) we can conclude that ||/i|| < j|A/ij|W* ( oj^ ] for all 7^ ft, £ X^. 



As ^P is monotonically increasing one then gets \\h\\ < ||A/ij|W$ (oTTf)' ■'^^'^ 
by Lcnuira 2.6 (a) the function S((^) ~ ^(C)/C is monotonically increasing and so 
S(Ci) > ^{(2) for < Ci < C2 < 00. This gives with Ci := ^ and C2 := jJEp the 



estimate \\h\\ < ^ \/^ (-^) for all h G B^{R) satisfying the additional condition 
||A/ij| < S. Thus the proposition is proven. D 

We note that for centrally symmetric and convex sets M, f G M, and regularised 
solutions fadis G M obtained from the discrepancy principle of form (23) mentioned 
in Remark 2 we easily derive along the lines of [16, Lemma 2.2] that 

(31) ||/-/„,J|<c^(2il/,(Cdis + l)<5) 

with 2A/ -.^ {ue X : u = 2w, we M}. In the case M = B^{R) with 2M = B^{2R) 
the estimate (31) yields with (30) a convergence rate of the form (24) with constant 
K = 4i?^/(Cdis + 1)^. With more generality such rates were verified above directly 
from Corollary 2.7. 

Under weak additional assumptions (see [16, Corollary 3.7]) there is also a con- 
stant C > such that 



uj{B^{R),6)>CsJ^(^^y S>0. 

Then a convergence rate of the form (24) is order optimal independent of the con- 
stant A' > because of 7* (^) < max{C, l}y^^ (^) for all C > 0. On the 
other hand. Corollary 2.8 yields an error estimate of best order just for £^{S) ~ S, 
hence the discrepancy principle is order optimal in that sense. 

Evidently, under the assumptions of Proposition 2.9 with the additional setting 

*"i(A) 1 

m ,(A) :. ^ . -j^j^, «<A<oo 

one has 

^{A*A)[B{R)]=B^{R) 

where B^{R) denotes the ball (20) of radius R in X^, an element of the Hilbert scale 
generated by T = [A* A)^'^ expressed through the index function x- We emphasise 
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that the upper bound in (30) for the modulus of continuity from Proposition 3.1 
needing only one function VP has a much simpler structure than the nested upper 
bound in (28) composing the functions 'tjj and 9~^. Also the required concavity of 
^ for obtaining (30) looks much simpler than the needed concavity of the composite 
function 

^2((e2)-l(i)) = i;\Q-\Vi)), < t < oo, 

for obtaining (28). 

Owing to the correspondence (25) between the concave index function '^ and the 
rate function ip it is of some interest to compare the quality of the estimates (28) 
and (30) as well as the strength of conditions which have to imposed in order to 
ensure those bounds for w. 

Proposition 3.2. Let ^(A), for < A < oo, be a concave and strictly increasing 
index function satisfying the limit conditions lim ^(A) = 0, lim ^(A) = oo and 

A— »+0 A— >co 

(12). Then for the rate function tp{t) := 1/ y''t'i>^^{l/t) (cf. (25)) and by setting 
Q(t) := v<?/j(i), < t < oo, we have the following assertions: The error bounds in 
(30) and in (28) and the corresponding concavity conditions required for obtaining 
those bounds coincide, i.e., we have 

(33) '^\/*(?) ^^^^(^"'(1))' ^>"' ^^^- 

Moreover, the function tp"^ {(Q'^)^^ (t)) is concave for all < t < oo. 

Vice versa, any rate function tlj(t), < i < oo, determines by equation (25) in a 
unique manner a strictly increasing index function ^(A), < A < oo, satisfying the 
limit conditions lim \E'(A) = 0, lim ^(A) = oo and (12) which is concave for all 

A^+O \—Kx> 

< A < OO i/ '0^((O^)~^(t)) is concave for all < t < oo which again implies the 
coincidence (33) of the error bounds. 

Proof. First we find from Proposition 2.9 that '0(t), i > 0, is a rate function if 
^(A), < A < oo is a concave and strictly increasing index function satisfying the 
limit conditions lim ^(A) = 0, lim ^(A) = oo and (12). Then from the right 

A— i.+0 A— >oo 

equation in (32) (cf. (25)) wc have 4'^^(A) = A/-0^(1/A). By using the bijcctive 
substitution u = 1/A in (0, oo) this yields ^^^(l/u) = „/. , and ■^ = ^ ( qA„-, 
for < u < oo. Multiplying the last equation by the factor mp'^{u) we derive 

^^(.) = .v7(.)*(^)^e^(.)v.(^ 

and '0(w) = 0(u)w'I' I q^tjt ). By exploiting the bijection t = Q{u) of (0,oo) into 



itself this provides us with the equation -0 (8 ^(f)) ~ 1\/^ {^) which implies the 
required identity (33) by inserting t := S/R and multiplying the arising equation 
byi?. 

In a second step wc note that by using the monotonically increasing bijection 
s = 0^(u) between s € (0, oo) and u € (0, oo) and once more by exploiting the right 
equation in (32) we can write as follows for all s > 0: 

^^((e^)-^.)) = ^p\u) = ^^ = e'{u)^(-^) ^s^(-)^ [5(*)](.). 



e2(u) 
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Hence, by Lemma 2.6 (b) we immediately see that as required ?/J^((8^)^^(s)), s > 0, 
is concave if 'I'(A), A > 0, is concave. 

Since the involution S (cf. Remark 1) preserves concavity, the reverse assertion 
formulated in Proposition 3.2 becomes immediately clear, since (25) represents a 
one-to-one correspondence between index functions ijj and strictly increasing func- 
tions ^ with the limit conditions under consideration. D 

We now investigate the concavity condition for the function ijP{{Q'^)^^{s)) in 
more detail. For this a characterisation of the concavity of index functions is given 
in terms of the monotonicity of certain divided differences. 

Lemma 3.3. Let tp be an index function. Then the three following statements are 
equivalent: 

(1) "0 is concave 

(2) (ip{sQ + s) — -0(so))/s is a decreasing index function for all sq > 

(3) {ip{so) — ip{so — s))/s is an increasing continuous function (0, sq) — > M_|_ for 
all sq > 0. 

Proof. If ■(/; is a concave index function then by Lemma 2.4 ip is increasing and so 
both {'ijj{s() + s)^tp{sQ))/s and {ip{so) — ip{so~'s)/s are positive continuous functions 
for s > and s G (0, so)i respectively. Furthermore by definition 

(i2 - to)V'(ii) > (h - ti)xP{to) + (ti - toH'{t2) 

and by simple algebraic manipulations and the right choice of to < ^i < ^2 one gets 
the second and third statement from the first. 

Conversely, if {ipiso + .s) — ■0(so))/s is a decreasing index function for all sq > 
one has for all to < ^i < ^2 

i^jti) - i;{to) ^ ^{t2)-iP{to) 

ii — io ^2 — to 

and thus '0 is concave. A similar argument shows that ^ is concave if the third 
statement holds. D 

A direct consequence of this lemma is that for concave rate functions -0 one has 

V'(go) -^(sp-g) ^ i^{so) 
s ~ So 

as lims_yo V'(s) — 0- Another consequence is 

Proposition 3.4. If tl){t) is a concave rate function then so is ipiwt)'^- 

Proof. By lemma 3.3 we have to show that for all to > the function (-(/'(^t + to)^ — 
'0(t— 0)^)/t is a decreasing index function. As the mapping s — > (s+sq)'^ is monotone 
it is sufficient to show that 

V(s + so)^-0(so)^ 

^(S) = 7 ^ 9 

(S + So)2 - sg 

is monotonically decreasing. 

As ijj is assumed to be concave. Lemma 3.3 implies that 

i'{s + So) - V'(so) 
cr(s) = 
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is monotonically decreasing. Furthermore 

"^■'^^ ^ "(^^ [ TT^o ) ^ "^^^ . + 2.0 ■ 

Now let S2 < S2. As a{s) is monotonically decreasing on has 

uj{si) > o- 52 —15 = cr S2) r— ^5 ■ 

Si + ZSq s - 1 + 2Sq 

The right-hand side is a decreasing function of si if 2so < 2?/;(so)/cr(s2), i-c, cr(s — 
2) < i'iso)- This is a consequence of Lemma 3.3 as stated in the remark after the 
lemma. Replacing si by S2 thus gives a lower bound for a;(si) and thus 

/ ^^ / ^2 g2+2V'(so)/g(s2) , ^ 

W Si) > Cr S2 — = W S2 . 

S2 + 2so 
It follows that uj is monotonically decreasing. D 

A consequence of this lemma is that for the concavity of the function ?/;^((6^)^^(s)) 
'4>'^{&~^{y/s)) it is thus sufficient to show that ?/» o 8~^ is concave. 

Finally we conjecture that a similar result to the proposition above also holds 
more generally, i.e., that a sufficient condition for concavity oi g o ip o g~^ is the 
concavity of tjj where g belongs to a class of suitably chosen functions. 

4. Linear regularisation approaches 

Our goal in this section is to draw conclusions from Corollary 2.7 for linear reg- 
ularisation methods. Taking into account the setting of Corollary 2.7 we assume 
throughout this section that the index function ^(A) is concave and strictly increas- 
ing for all < A < 00 satisfying the limit conditions lim ^(A) = 0, lim ^(A) = oo 

A— >-+0 A— >oo 

(cf. Lemma 2.5), and (12). Moreover, we set 

*"VA) - 1 

(34) x(A) := r-^ , < A < 00, and i/'(i) := , , < f < 00 . 

' v^ 

Then x is an increasing index function with lim xW = 00 and ip is an increasing 

_ A— >-oo 

index function with lim ibit) = 0, hence a rate function. As outlined in section 3 

t-i.+0 

under these assumptions we have ip{A*A)[B{R)] = B^{R) and the best case for 
regularised solutions /„ approximating the exact solution / G X^ based on data g^ 
satisfying (2) by using an a priori choice a — a{5) or a posteriori choice a — a{5, g^) 
is to achieve the order optimal convergence rate (24). It is a specific consequence 
of interpolation theory and can be seen easily by inspection of Corollary 2.7 that a 
successful use requires the focus on regularisation methods which yield regularised 
solutions of appropriate smoothness. Precisely, there must be a ball B^{R) to which 
the elements /„ belong for all a > attributed to sufficiently small i5 > and g^ 
satisfying (2). 

4.1. General linear regularisation schemata. In a first approach we are going 
to consider linear regularisation schemes as described in many textbooks on linear 
regularisation theory (see, e.g., [9, Chap. 4], [10, Chap. 2] and [2, 3, 22, 23, 29]). 
We consider approximate solutions 

(35) U:^h^{A*A)A*g'. 
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to / based on a family of piecewise continuous real functions ha{t), < t < |lA|p, 
to which we assign bias functions 

r„(t) ■=thcit)-l, 0<t< \\A\\^ . 

These functions depend on a regularisation parameter a G (OjQimax], where amax 
may be a finite real number or oo. Small a > characterise good approximation of 
the original problem (1), whereas larger values a arc connected with more stability. 
Hence, an appropriate trade-off between the two conflicting goals approximation 
and stability can be controlled by the choice of a. We say that such a function ha 
describes a linear regularisation method if the properties 

(36) lim r„(i) =0, 0<i< \\A\\^, 

a— >+0 

and 

(37) sup sup t\ha{t)\ < Ci 

0<Q<Q„„x 0<t<|tA|t2 

with a constant Ci > hold. Because of (37) we have another constant C2 > 
such that 

sup sup I ra {t) I < C2 

0<Q<Q,„ax 0<t<|[A|t2 

and hence for all < a < a„iax the estimate 



|A/„-.g^j| = \\{AK{A*A)A*-I)g'\\ < 



sup I ra (t) 

0<t<\\AP 



11/11 <C^2 11.9^1' 



This implies the limit condition lim \\Afa — 3 || =0 for all data g £ Y. As a 

a— y+O 

consequence we have that there is always a parameter choice a = a{6,g^), < i5 < 
6max, such that 

\\ALiS,g^) - g'W < Cd^s S {0<S< S„,ax) 

for some prescribed constant Cdis > 0. If the mapping a i-> \\Afa — <7''|1 is even 
continuous, then the discrepancy principle can be realised by a parameter choice 
C(dis = ctdis{5,g^) satisfying the equation (23). 

Here we call a rate function Cp a qualification of the regularisation method gen- 
erated by ha if there is a constant CquaU > such that 

(38) sup \rait)\(p{t) < Cguaii ifiia), 0<a:<amax- 

0<t<\\Ap 

Now we are going to study under what conditions the inequality (21) in Corollary 2.8 
can be fulfilled here with £^{S) ~ S. First we obtain 

(39) \\Afa~g\\ = \\Ara{A*A)f + AhaiA*A)A*ig'-Af)\\ < \\Ara(.A*A)f\\+C,S. 

In order to apply that corollary for obtaining a convergence rate (24) we assume 
/ e B^{Ri) ~ ■0(A*A)[_B(i?i)] taking into account the cross-connection (34). So 
let / = '4){A*A)v, \\v\\ < Ri. Provided that Q{t) := Vi'ipit) is a qualification of the 
method with constant CquaU > this gives with (39) 



(40) P/„-.g||< 



sup ra{i)Q{t) 

0<t<||A|P 



Ri+Ci5<CquauRiQ{a)+Ci5 



and hence an estimate of type (21) is fulfilled with ^((5) = 5 when an a priori 
parameter choice a = Q^^{5) is used. 
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Next we will check whether /„ e i?^(i?2) for some < i?2 < oo. We have 
U = h^{A*A)A*{g' - Af) + ho.{A*A)A*Af 
and after some reformulation 

/„ = ^{A*A) \ha{A*A){i:{A*A))-^{A*A)^/'^g + ha{A*A)A*Av 

with jigji < S, since the different functions of A* A are commutable. Now let the 
interplay of the regularisation method expressed by ha (t) and the parameter choice 
a = a{S,g ) be such that there is a constant Cpara > with 

(41) sup f-f-^ < Cpara, 0<5 < 8,-aax ■ 

o<t<|!A|p ip[t) 

The upper bound Cpara in (41) must hold for all data g^ ^Y associated with the 
noise level 5 > Q and satisfying (2), where the case of an a priori parameter choice 
a — a{5) should be included as a special case. Under (41) we have with (37) 

\\ha(s,g.){A* A){i^{A* A))-\A* Af/^+h^(s.g^^{A* A)A* Av\\ < R2 := Cpara+C^Ri, 

in other terms fa(s,g^) € i){A* A)[B{R2)] = B^{R2). 

If there is a function r(a) satisfying for sufficiently small a > the inequality 



(42) 



^^t\ha{t)\ 

0<i<|M||2 Wit) 



< T{a) 



such that 

(43) 5T{a{5,g^)) < Cpara, Q < 5 < 5^a. , 

this represents a sufficient condition for (41). In particular, if moreover the a priori 
parameter choice a{5,g^) := 8^^(^) satisfies (43) we have an estimate of type (21) 
with ^(5) =5 for that a priori parameter choice whenever is a qualification of the 
regularisation method under consideration. 

Hence the considerations above gave a sketch of the proof for the following propo- 
sition as a consequence of Corollary 2.8: 

Proposition 4.1. Under the standing assumptions of this section including (34) let 
f G X^ = range('0(A*j4)) and consider regularised solutions (35) with a generator 
function ha that determines the regularisation method and satisfies (36) ~ (37) as 
well as (42) with some function T such that Q{t) := \/t{li(t) satisfies (43) with some 
constant Cpara > and is a qualification of the method (cf (38)). Then for the a 
priori regularisation parameter choice a = aiS) := 0^^((5) — > +0 as 5 ^ +0 we 
have the convergence rate 



(44) ||/-/„|| = OU^*(A7<52)l as <5 ^ +0 

with some constant K > 0. 

Note that in Proposition 4.1 the rate (44) also holds for any other parameter 
choice a = a{6,g^) that fulfils the inequalities (43) and 

(45) \\AfaiS,g^) - 9\\ < C S, 0<5<S„,a., 

with some constant C > 0. 
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Example 1. The most prominent example of a linear regularisation method (35) 
is the Tikhonov regularisation with the generator function ha{t) = j^ and with 
the bias function ra{t) = j^, where the requirements (36) and (37) are satisfied 
for the constants Ci ~ C2 ~ I- It is well known that all concave rate functions 
(f are qualifications of the method satisfying (38) with the constant Cquaii = 1- 
From that class we consider the monomials (f{t) = t" for exponents < j^ < 1- 
Then 8(t) — ^/t^{t) is a qualification with the same constant for the Tikhonov 
regularisation in case of a rate function ip{t) = t^ with Q < ^ < 1/2. Taking 
into account (34) this rate function is associated with x(A) = A^*^ and the strictly 
concave function ^(A) = A^i^+r. By the estimate (40) we have then (45) with 
C* = i?i + 1 for / = [A* AYv, \\v\\ < Ri and for the a priori parameter choice 

(46) a = e-\S)=d^ . 

To derive a function F such that (42) is valid, we exploit the inequality 

— — < (l-K)i^'"K'^a'=-i, 
t + a 

which holds for alH > 0, a > and < k < 1. In the limit case k = we also have 

the inequality l/{t+a) < 1/a. Thus there is a constant c > depending on k £ [0, 1) 

such that j^ < ^ji^TTT. By setting k :— 1/2 — fj. we obtain for ^(t) = f^, < /i < 1/2 

the inequality (42) with the function 

F(a) = 



Then one easily verifies tha.t 5T{Q-\5)) < ^^^ ^^^ = c and that (43) is fulfilled 



with Cpara = c. Hcncc Proposition 4.1 applies and we obtain for the parameter 
choice (46) and all < /.i < 1/2 the optimal convergence rate 

ll./-/aiHC'('5^) as S^+0. 

The best possible rate obtained in that way is ||/ — /q|| = O (v^) for /i = 1/2. 
For n > 1/2 the function ^ remains strictly concave, but a finite function F(a) in 
(42) fails to exist, since we have sup j,^,;/, — r — +00. The limitation of Propo- 

^ ^ 0<t<||A|P ^(*^(*+") 

sition 4.1 to lower Holder rates than the saturation of Tikhonov's method admits 
seems to be a consequence of the fact that our approach based on Corollary 2.8 
and the construction (35) do not interact good enough in case of higher smoothness 
of /. In order to overcome that effect, we will consider another approach in the 
following subsection. 

4.2. Regularisation with unbounded operators and range inclusions. In 

a second approach, under a non-standard source condition (5) characterising the 
available a priori knowledge on the solution smoothness, we exploit a variant of the 
Tikhonov regularisation with regularised solutions 

(47) fo, := G{GA*AG + aI)-^GA*g^ , 

where G : X ^ X is an injective bounded self-adjoint positive definite linear op- 
erator G : X ^ X with non-closed range, i.e., zero is an accumulation point of 
the spectrum spec(G') of the operator G. Since the unbounded linear operator with 
B = G~^ : range(G) C X ^- X is frequently a differential operator, this approach is 
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sometimes called regularisation with differential operators. Precisely, by construc- 
tion the element /« € range(G') is well-defined for all a > as the minimiser of the 
extremal problem 

T„(/) := \\Af -g^f + Q'||B/f -^ min, subject to / e range(G), 

and then the penalty term in T^ contains derivatives of the function /. 

To apply Corollary 2.8 under our setting (34) we assume / e G[i3(i?i)], with 
G[B{Ry\ from (26), and a link condition 

(48) range(G) C X^ = vange{i){A* A)) , 
which is equivalent to 

(49) \\Gw\\<C\\ij{A*A)w\\, for all w e X, 

with some G > 0. Then from [15, Lemma 6.2] we obtain that / S G[B{Ri)] implies 
/ e B^iCRi) = '^iA*A)[BiCRi)]. 

Along the lines of the paper [7] by Cheng and Yamamoto we consider an a 
priori parameter choice a = a{S) as 

(50) cS^< aid) <cS^, 0<S<S^a., 

with constants < c < c < oo, for which wc obtain from Ta{fa) < Ta{f) the 
inequalities 

P/a(5) - /ir + o((5)|lG-Vawll' <\\Af- g'f + a{6)\\G-^ff < S' +cS'- RJ . 
Now we have 



WAfc^iS) ~ g\\ < C S, with C=^l + cRi + l 
satisfying condition (21) with ^((5) = S and 



I|G-\L,-,||<^^ + ||G-W<yi7^=:i?.. 

This yields f^^s) e G[B(i?2)], thus fa(s) S B^{GR2) = ipiA*A)[B{GR2)] and con- 
sequently an estimate of type (22) with ^(6) = 5 and CRi, GR2 instead of i?i, i?2- 
With the above considerations we have shown the convergence rate result of the 
following proposition again as a consequence of Corollary 2.8: 

Proposition 4.2. Under the standing assumptions of this section including (34) 
let f satisfy (5), where the link condition (4-8) is valid. Then for the a priori 
regularisation parameter choice (50) we have the convergence rate (44) with some 
constant K > Q. 

Due to [16, Corollary 4.5] for all concave 4* fulfilling the standing assumptions 
of this section the rate (44) is even order optimal in the sense of 

o(5\f^{Rj¥)\=0{uj{G[B{Ri)l5)) as 5 ^ +{) . 

As already discussed in the introduction the requirement (48) gets stronger for 
higher rates in (44). In many applications (see as an illustration the examples in 
[18]) one can only verify range inclusions of the form (8) with some rate function 
Q. Under operator monotonicity of the function [p~^{\/i)Y (8) implies (48) with 

m = -p-\Vt) and x(A) = [p-^ (i/\/a)" 
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In order to verify in general for what index functions x & range inclusion (48) 
with range(G) C X^ is fulfilled, one can use the spectral theorem for unbounded 
self-adjoint operators T (see [34, Chapter VII. 3] and also [28, Chapter VIII]). In 
the Hilbert space X, the injective, densely defined, self-adjoint, positive definite, 
and unbounded linear operator T is unitarily invariant to a multiplication operator 
A^ expressed by a real multiplier function m. This means that there are a measure 
space (E,v4, /i) with finite measure /i, a unitary operator U: X ^ L^(S,v4, /i) and 
a real measurable function m{t), t £ Y,, such that [A4h]{t) := m{t)h{t) a.e., where 
M. maps in L^(I],^,/i), and 

UTW h^ Mh^m-h 

for all h from the domain of M.. We note that the closure of the range range(m) of 
the multiplier function m and the spectrum spec(T) C [||T||~^,oo) of the operator 
T, possessing -|-oo as an accumulation point, coincide. Moreover, we have for index 
functions i/' G I and h from the domain of ?/'(A^) 

U^{T)Wh = tP{M) h^i}}{m)-h. 

Then by using the notations f -.^Uf e i^(S, A, fi) and (Gw) -.= 110 w e L'^{T,, A, fi) 
by definition we immediately find that range(G') C X^ is equivalent to the condition 
that 

(51) {Gw,x{T)Gw) = {(g^),x{M)(Gw)),2,^^^^^, ^ j x{m{t))\(G^){t)\^dt < oo 

s 

holds for all w £ X. In Example 2 with background in imaging (cf. [30]) we will 
consider the special case that U denotes the two-dimensional Fourier transform and 
that the corresponding measure space is {M.'^,B{M.^), fj.) with the associated Borel 
(T-algebra and measure. In that example, T and G are commuting operators, both 
non-compact with a non-closed range. 

On the other hand, in Example 3 we will exploit the one-dimensional Fourier 
transform to formulate sufficient conditions such that classical source conditions 
are satisfied for linear compact integral operators. 

5. Examples 

In the remaining examples we illustrate the theory. All the occurring operators 
A are linear integral operators. First the Example 2 refers to convolution operators 
A which occur, for example, when the deblurring of noisy images is under consider- 
ation. Then the Example 3 illustrates the low rate case where an integral equation 
with a smooth kernel is solved and it is known that the solution is in a Sobolev 
space. The situation here is similar as in the case of elliptic partial differential 
equations and has been discussed in [6]. In contrast to the PDF situation here 
convergence rates are low, typically of the form 0{\ log((5)|~'"'). The final Example 4 
illustrates the high rate case where a derivative of data in the range of an integral 
operator with smooth kernel is considered. The high convergence rates are here of 
the form 0((5|log(5)|'^). 

In the examples we consider functions over E** (d = 1,2) and Sobolev spaces 
H'^iR''') {I = 1, 2, ...) of Hilbert type wiU be used with norms || • ||; defined by 
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where x = x{uj), uj G M.'^, is the Fourier transform of x. Now let Ei : H''{M.'^) — ^ 
L'^{R'^) denote the embedding and E^ the adjoint of Ei. Then EiE^ : L 
I/^(IR'^) is an integral operator and 



d^ ^ 



Example 2. In this example with X = Y = _L^(R^) we are interested in deblurring, 
that means in finding a true picture which is characterised by a function f = f{t) G 
i^(M^), t = (^1,^2)^, that satisfies a linear operator equation (1) of convolution 
type 

(52) Af (s) = f k{s- t)f{t) dt = g(s), s = (si, S2)" € R\ 



where g € L^(M^) is a blurred image of / which is additionally contaminated with 
noise such that only the noisy blurred image g^ e L^(R^) satisfying (2) available as 
data. Following [4, Chapter 3] the kernel function A:(t), t = (ti,T2)^ G K^, is called 
point spread function of a space invariant imaging system under consideration. We 
assume that the kernel is such that its Fourier transform k = k{oj) ,ui = (a;i,a;2)^, 
called transfer function is bounded. Different variants of such deblurring problems 
are presented and analysed in [4] . As a reference situation we exploit for illustration 
a variant of an out-of-focus blur for which 



k{uj) = 2- 



DU 



where Ji is the Bessel function of order one and D is the radius of the circle of 
confusion (cf. [4, formula (3.25) on p. 60]). The linear convolution operator A : 
L'^iM.'^) — > L'^{M.'^) in this example has a non-closed range but it is non-compact and 
the kernel is not square integrable. 

In order to apply our theory to this example one needs to find an index function 
9 and a symmetric positive definite operator T such that A* A = 9{T). A natural 
choice in this context is T = —A and in this case needs to satisfy |fc(a;)p = 0(|ajp). 
This, however, is not possible, as k{uj) is zero for some finite ui but an index function 
has to satisfy 9{X) > for all A > and it can only be zero asymptotically at zero 
or infinity. It is thus not possible to get error bounds for the deblurring problem 
using the variable Hilbert scale theory and T = — A. 

One does not have this problem if one chooses T — {A* A)^^ . Let us define 
the solution smoothness as / G H'-iM?). Then we have the operator G = E^Ei 
in (5) characterising the associated non-standard source condition. To find index 
functions x that satisfy the link condition (48) we can make use of formula (51) 
taking into account that 771,(0;) = l/|/s(cj)p and 

|gS(u;)|2 = (1 + |cc;|2 + . . . + |w|2')-i|u,(w)|2. 

Then the range inclusion range(G') C X^ takes the form 

(53) X I -^ — I T. — rrr^ rr^ <C <oo for aU w e M^ 

This range condition can only be satisfied if x is bounded, i.e., i.e. x(A) < C < 00 
for all A > 0. This is again a consequence of the existence of zeros of fc(aj) for finite 



REGULARISATION ERRORS AND VARIABLE HILBERT SCALES 23 

w. A consequence of the finiteness of x is i^(K^) C H^ and it follows that the 
"source condition" reduces to / G L^(]R) which does not lead to an error bound. 

The failure of the above attempts to get error bounds clearly illustrates the need 
to extend the variable Hilbert scale theory to be able to cope with the deblurring 
problem. One can, however, deal with a partial deblurring problem. Observe that 
one has the asymptotics 



Ji{D\u\ 



D\lo\ 



-3/2 



for large \uj\ (cf. [4, formula (3.29) on p.60]). It follows that k{uj) = \uj\-^/'^k{uj) 
for some bounded k(cl'). The first factor |a;|'^/^ relates to a "smoothing component" 
of the out-of-focus blur situation. We now consider inversion of this smoothing 
component only. For this we introduce an integral operator A with kernel k which 
satisfies 

(54) k{u) = |w|3/2. 

For the "partial" out-of-focus blur situation (54) and monomials xW = ^'^^ ^ > 
0, we have (53) if and only if k < y. With the relation x(A) = ^~^(A)/A this 
corresponds with ^(A) < A''/(^'+^' . Hence based on Proposition 4.2 for the situation 
(54) and under / e iJ'(K^) a best possible convergence rate 



||/-/a||.^(E^, =0(^^'^j as 5^+Q 
can be obtained by Tikhonov regularisation with _ff'-penalty term. 

Example 3. In this example we consider compact forward operators A in equation 
(1) with X = Y ^L'^{M) in form of linear operators A : L'^{M.) -^ ^^(M), for which 
the range of the operator K := -iplA* A) is a subset of H^ with some index function 
(f> and some rate function tp. That means, we have range(A') C H^ and a classical 
source conditions (4) is valid for / G H^ implying the corresponding convergence 
rates in regularisation. In this context, let K be a linear Fredholm integral operator 
of Hilbert-Schmidt type. For such operators one can provide conditions on the 
kernel which guarantee this range condition. 

Lemma 5.1. Let K : L^(R) — >■ L^(R) he a Hilbert-Schmidt operator with kernel 
k{t, s) e i^(]R^). Furthermore, let K : L^(]R) — >• L^(R) be an integral operator with 
kernel k{u!, s) = J„ e~"^*fc(t, s) dt. Then K is a Hilbert-Schmidt operator and 

Kx = 'Kx, x£L\R). 

Proof. The adjoint operator K* of K is an integral operator with kernel k*{s,t) = 
k{t, s) as a consequence of the theorem of Fubini. By Plancherel's theorem one has 

K u ~ — K u. 

27r 

An application of Parseval's identity several times gives for u,v E L^(R): 

— {u,Kv) = {u,Kv) 
= {K*u,v) 

= —(K*u,v) 
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D 

Proposition 5.2. Let K : L^(]R) — > ^^(IR) he a Hilhert- Schmidt operator where the 
Fourier transform k{LU, s) ~ L e~*"*fc(t, s) dt of the kernel of K satisfies 

'(aj^)|fc(cj, s)p dsdoj < oo 

for some index function (p. Then range(ii') C H^. 
Proof. By Lemma 5.1 one has 

y{u}) =: / k{uj,s)x{s) ds 

which wo insert into the following bound, obtained from the Cauchy-Schwarz in- 
equality: 

fc(w, s)x{s) ds 



< / \k{u;,s)\Us\\x\\'. 
Jr 

It follows that for y ~ Kx with x G L^ (R) one has 

l|y||0 = ^^0(^')|yHI'rf^ 

<— / I (t){uj'^)\k{uj,s)\^dsdio\\x\\'^ 

27r Jk Jr 

and consequently y G H^. D 

Example 4. As a concrete application example we consider a problem from deriva- 
tive spectroscopy [31]. Here numerical derivatives are used to enhance the resolution 
of measured spectra in order to separate close peaks. An instance is the Eddington 
correction formula. The approach determines 

g(2) 

/ = Lg —g---^ 

from observed gs where g^"^' is the second derivative of g. Wc now apply the theory 
developed so far to determine how well / = Lg can be determined from spectral 
data gs- 

For / G H'^{M.) and f = Lg the Fourier transforms / and g satisfy 

/(w) = (l+c^V2)ffH, a.e. 
Using Plancherel's theorem, one obtains from this the bounds 

^||/||2<||L/!I<||/||2, feH^R) 

which means in particular that ||i/|| is an equivalent norm for iJ^(M). Using 
standard arguments, one can then show that L : i?^(M) -^ L^(M) is a Hilbert space 
isomorphism. Using the convolution theorem one sees that A = E2L^^ : _L^(R) — > 
L^(M) is an integral operator with 

Af{t) = ^ f cxp{^V2\t~s\)f{s)ds teR 
V 2 Jr 

where E2 denotes the embedding H'^{R) -^ L^{R). As L^^ maps L'^(R) onto H^{R) 
the range of A can be identified with H'^{R). 
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In addition to the Sobolev spaces, which form a classical Hilbert scale, we will 
use a variable Hilbert scale H^ with norms || ■ ||</, defined by 

(27r) 7_oo 

where 4> are index functions. Note that wc have here H^f, ~ X^ for X = L'^{M.) 
(see [If]) and the generating operator is the second order differential operator T = 
—(P/dt^. The index functions 

i.fc(A) = I + A + ■■■ + >*= = ^-—^ 

define the Sobolev spaces, in particular, one has H^^, = H^{R) and furthermore, 
the Sobolev norm is equal to the norm of the corresponding variable Hilbert scale: 

ll/IU = 11/11.., I^H,.- 
In this framework, we now get error bounds analogue to the ones in Corollary 2.7 
which are again a consequence of Lemma 2.3. 

Corollary 5.3. Let Hi, be the Hilbert scales generated by T ~ —d^/dt^ from L^(R). 
Furthermore, let A : L^{M.) — > L^(]R) be a (convolution) operator satisfying 

A* A = 0(T) 

for some bounded index function 9. Moreover, let 0, ijj and ^ be index functions 
and Vt be concave such that 

0(A) < *(^(A)), <j)iX)0{X) = 1, for t > 0. 

// Af = g e H.^ and if fa is such that Afa G H.^, and 

\\Afa-9\\t^C 

\\Afa-g\\=e 

then 

\\f-fa\\<eVW<y^)- 

Proof. Note that 0{T) is well defined by the Fourier transform and as 8 is bounded, 
so is A. Furthermore it follows from the condition A* A = 9{T) that \\h\\g — \\Ah\\ 
for all h e L^(M) and \\h\\^g = ||A/i||^,, for all h with Ah € H^. 

By the variable Hilbert scale interpolation inequality (Lemma 2.3) one has 



11/ -/al 



Now 0(A)6l(A) = 1 and \\fa - f\\e = \\AJa - g\\ as fa - f e L'^{R). Furthermore, 
Wfa - fWtpe = \\Afa — g||v.- By Lemma 2.6 one then has 



WU f\\ < \\Afa 9\\^^{\\Afa g\\l/\\Afa - ffP)- 

The bound follows by another application of Lemma 2.6. D 

In comparison with Corollary 2.7 this corollary uses an operator T which is not 
necessarily equal to {A* A)^^ but more importantly, the source condition is here not 
given as a property of the solution / but of the data g. 

For the application of this corollary to the case of the Eddington correction 
formula one chooses 9{X) = 1/(1 + A/2) and so 0(A) = 1 + A/2. 
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In contrast to the usual case, where the source condition is stated as a condition 
on /, here the source condition is stated as a condition on (the original spectrum) 
g. This source condition results from physical models for the spectrum, and, in 
particular for the so-called spectral broadening. A variety of models are used, 
the most common ones arc the Gaussian, Lorenz and Voigt spectra where a Voigt 
spectrum is a combination of a Lorenz and a Gaussian spectrum. Here we consider 
Gaussian spectra defined by 

g{t) = -^ I exp(-(f - sf/2)v{s) ds 
V 2,1: JR 

for some v G L^ (M) . For a different discussion and more background on the problem, 
the reader may consult the paper by Hegland [13]. 

It follows that g G H^ with 4'W ~ cxp(A). The concave function ^ can then be 
chosen as 

'a, forA<l 

_(l + log(A)/2)2, forA>l. 

It follows that ^ is concave and that (f){X) < ^(■0(A)). As a consequence one gets 
the error bounds 

11/ -/all < <5(1 + l0g(77/<5)) 

ior 6 < 1] and ||/ — /a|| < r/ if (5 > e. The stabilisation guarantees that even if the 
errors arc very large, the error of the approximation docs not grow to infinity. In 
fact, the solution /« — would probably be a good choice for the large data error 
case. 



*W w, ,,^_..w.^2 



[9; 

[lo; 

[11 
[12; 
[is; 



References 

K. Atkinson and W. Han, Theoretical Numerical Analysis - A Functional Analysis Frame- 
work, 3rd ed., Texts in Applied Mathematics, vol. 39, Springer, Dordrecht, 2009. 
A. B. Bakushinsky and M. Yu. Kokurin, Iterative Methods for Approximate Solution of In- 
verse Problems, Springer, Dordrecht, 2004. 

J. Baumeister, Stable Solution of Inverse Problems, Friedr. Vieweg & Sohn, Braunschweig, 
1987. 

M. Bertero and P. Boccacci, Introduction to Inverse Problems in Imaging, Institute of Physics 
Publishing, Bristol, 1998. 

R. Bhatia, Matrix analysis. Springer- Verlag, New York, 1997. 

A. Bottcher, B. Hofmann, U. Tautenhahn, and M. Yainamoto, Convergence rates for 
Tikhonov regularization from different kinds of smoothness conditions, Appl. Anal. 85 (2006), 
no. 5, 555-578. 

J. Cheng and M. Yamamoto, One new strategy for a priori choice of regularizing parameters 
in Tikhonov's regularization. Inverse Problems 16 (2000), no. 4. 

D. Diivelmeyer, B. Hofmann, and M. Yamamoto, Range inclusions and approximate source 
conditions with general benchmark functions, Numcr. Funct. Anal. Optim. 28 (2007), no. 11- 
12, 1245-1261. 

H. W. Engl, M. Hanke, and A. Neubaucr, Regularization of Inverse Problems, Kluwer Aca- 
demic Publishers, Dordrecht, 1996. 

C. W. Groctsch, The Theory of Tikhonov Regularization for Fredholm Eguations of the First 
Kind, Pitman, Boston, MA, 1984. 

M. Hegland, An optimal order regularization method which does not use additional smooth- 
ness assumptions, SIAM J. Numer. Anal. 29 (1992), no. 5, 1446-1461. 

, Variable Hilbert scales and their interpolation inequalities with applications to 

Tikhonov regularization, Appl. Anal. 59 (1995), no. 1-4, 207-223. 

, Error bounds for spectral enhancement which are based on variable Hilbert scale 

inequalities, 2009, http;//www.citebase.org/abstract?id=oai:arXiv.org:0911.2695. 



[14 

[is; 
[16; 
[17; 

[is: 

[19 

[2o; 

[21 

[22; 

[23' 

[24' 

[25; 

[26; 
[27; 
[28; 
[29; 
[30; 

[31 

[32; 
[33; 

[34 



REGULARISATION ERRORS AND VARIABLE HILBERT SCALES 27 

B. Hofmann, Approximate source conditions in Tikhonov- Phillips regularization and conse- 
quences for inverse problems with multiplication operators, Mathematical Methods in the 

Applied Sciences 29 (2006), 351-371. 

B. Hofmann and P. Mathc, Analysis of profile functions for general linear regularization 

methods, SIAM J. Numer. Anal. 45 (2007), no. 3, 1122-1141. 

B. Hofmann, P. Mathe, and M. Schieck, Modulus of continuity for conditionally stable ill- 
posed problems in Hilbert space, J. Inverse Ill-Posed Probl. 16 (2008), no. 6, 567-585. 

B. Hofmann, P. Mathe, and H. von Weizsacker, Regularization in Hilbert space under un- 
bounded operators and general source conditions. Inverse Problems 25 (2009), no. 11, 115013. 

B. Hofmann and M. Yamamoto, Convergence rates for Tikhonov regularization based on 

range inclusions. Inverse Problems 21 (2005), no. 3, 805-820. 

T. Hohage, Logarithmic convergence rates of the iteratively regularized Gauss-Nevuton method 

for an inverse potential and an inverse scattering problem. Inverse Problems 13 (1997), no. 5, 

1279-1299. 

, Regularization of exponentially ill-posed problems, Numer. Funct. Anal. Optim. 21 

(2000), no. 3-4, 439-464. 

V. K. Ivanov and T. I. Koroljuk, The estimation of errors in the solution of linear ill-posed 

problems., Z. Vycisl. Mat. i Mat. Fiz. 9 (1969), 30-41. 

A. Kirsch, An Introduction to the Mathematical Theory of Inverse Problems, Springer- Verlag, 

New York, 1996. 

A.K. Louis, Inverse und schlecht gestellte Probleme, B. G. Teubner, Stuttgart, 1989. 

P. Mathe and S.V. Pereverzev, Discretization strategy for linear ill-posed problems in variable 

Hilbert scales, Inverse Problems 19 (2003), no. 6, 1263-1277. 

, Geometry of linear ill-posed problems in variable Hilbert scales. Inverse Problems 19 

(2003), no. 3, 789-803. 

P. Mathe and U. Tautenhahn, Interpolation in variable Hilbert scales uiith application to 

inverse problems, Inverse Problems 22 (2006), no. 6, 2271-2297. 

F. Natterer, Error bounds for Tikhonov regularization in Hilbert scales, Appl. Anal. 18 (1984), 

no. 1-2, 29-37. 

M. Reed and B. Simon, Methods of Modern Mathematical Physics I: Functional Analysis, 

second ed.. Academic Press Inc. [Harcourt Brace Jovanovich Publishers], New York, 1980. 

A. Rieder, Keine Probleme mit inversen Problemen, Fricdr. Vieweg & Sohn, Braunschweig, 

2003. 

O. Scherzer, M. Grasmair, H. Grossauer, M. Haltmeier, and F. Lenzen, Variational Methods 

in Imaging, Applied Mathematical Sciences, vol. 167, Springer, New York, 2009. 

F.R. Stauffer and H. Sakai, Derivative spectroscopy. Applied Optics 7 (1968), no. 1, 61. 

H. Tanabe, Equations of evolution. Monographs and Studies in Mathematics, vol. 6, Pitman, 

Boston, Mass., 1979, Translated from the Japanese. 

U. Tautenhahn, Error estimates for regularization methods in Hilbert scales, SIAM J. Numer. 

Anal. 33 (1996), no. 6, 2120-2130. 

D. Werner, Funktionalanalysis, extended ed.. Springer- Verlag, Berlin, 2000. 
E-mail address: inarkus.heglandSanu.edu.au 
E-mail address: bernd.hofmannOmathematik.tu-chemnitz.de 



